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1.  Introduction 


The  classical  theory  of  robust  estimation  of  a  location  parameter  was 

developed  by  Huber  (1964,  1981)  in  the  following  setting:  Let  Xt ,  X  , .  ..,x 

x  2  n 

be  a  random  sample  from  a  distribution  F(x-0),  where  0  is  an  unknown  location 

parameter.  The  distribution  function  F  is  not  precisely  known,  but  is  assumed 

to  be  in  a  convex  neighborhood  P  of  a  model  distribution  G.  The  goal  is  to 

estimate  0  efficiently  by  a  functional  TflF^),  where  denotes  the  empirical 

distribution  function  associated  with  X^,  X^» . . .  ,  X^.  For  example,  an  M-estimate 

T(F  )  is  a  solution  t  of 
n 

1  n 

0  =  /^(x-t)dJF  (x)  =—  E  ^(x.-t) 
n  n  .  ,  x 
x=l 

for  some  estimating  function  ip.  Under  suitable  regularity  conditions  [see 

Huber  (1967),  Boos  and  Serfling  (1980)),  TOF^)  is  a  consistent  estimator  of 

0,  and  ✓nCK®’)-®)  is  asymptotically  normally  distributed  with  mean  zero  and 
n 

variance  V(if/,F) .  One  wishes  to  choose  the  estimating  function  which 
minimizes  the  maximum  variance  over  all  distributions  in  P: 

sup  V(i|/  ,F)  =  inf  sup  V  (i|>,F)  . 

F€P  F6  P 

Let  Fg  be  the  distribution  minimizing  the  Fisher  information 

1(F)  =  /( f’/f)2f 

over  P,  where  f  =  F’.  Under  general  conditions  there  is  a  unique  least- 
informative  distribution  in  a  convex  neighborhood  P  of  G  [see  Huber  (1981), 
§4.4)  By  the  Cramer- Rao  bound,  the  asymptotic  variance  of  T  at  FQ  is  at  least 
1/I(FQ).  Finding  a  sequence  of  estimates  {t^}  for  which  the  asymptotic 
variance  is  at  most  1/1  (FQ)  for  any  F  fc  P  then  solves  the  minirnax  problem. 

Under  suitable  conditions,  -  -  f^/fg  *s  the  desired  minimax  estimating 
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function,  where  f0  =  F^.  Thus,  a  crucial  step  in  this  approach  is  the 
determination  of  the  least  informative  distribution  in  an  appropriate 
neighborhood  of  the  model  distribution.  However,  the  least  informative 
distribution  is  known  only  for  a  rather  restricted  class  of  model  distributions 
and  neighborhoods. 

The  theory  is  most  completely  developed  for  the  e- contamination  neighborhood 
of  the  model  distribution  G,  defined  by 

P£CG)  =  {F  =  (l-e)G  +  £H:  H6  *0, 

where  M  denotes  the  set  of  probability  distributions  on  ]R.  Huber  (1964) 
treated  the  location  problem  for  symmetric  distributions  in  the  e-contamination 
neighborhood  of  a  model  distribution  G  with  a  log-concave  density  g.  The 
least- inf ormative  density  is  equal  to  (l-£)g  on  a  central  interval  and  is  an 
exponential  function  on  each  of  the  remaining  unbounded  intervals.  Buber’s 
method  of  proof  provides  the  motivation  for  our  approach,  and  is  sketched  at 
the  opening  of  section  2.  Collins  (1976)  investigated  a  class  of  densities 
which  were  equal  to  the  normal  density  on  an  interval  of  the  form  [-d,d)  and 
allowed  asymmetry  outside  this  interval. 

The  e-Kolmogorov  neighborhood  of  the  standard  normal  distribution, 
defined  by 

=  {F6M:  sup[F(x)  -  $(x)  |  <  e} 

has  been  studied  by  Huber  (1964) ,  who  determined  the  least  favorable  distribution 
for  e  <  eQ  ~  .0303,  and  by  Sachs  and  Ylvisaker  (1972)  for  e  >  e^. 

This  paper  determines  the  form  of  the  least  informative  distribution  in 
the  e-contamination  neighborhood  for  a  broad  class  of  model  distributions. 

Since  the  assumption  of  a  log-concave  model  density  in  Huber  (1964)  is 


equivalent  to  strong  uniinodality  of  G,  [Ibragimov  (1956)],  the  assumption 
is  quite  restrictive.  Our  result  is  more  broadly  applicable,  being  valid 
for  any  model  distribution  G  with  a  density  which  has  a  finite  number  of  local 


maxima . 


Let  G  denote  a  model  distribution  with  density  g  =  G'.  For  each  k  >  0, 


define 


F(k)  =  {h:  hlx)  =  bcosn  [~(x-a>]  and  htx)  >  g  (x)  V  x6IR} 


C(k)  =  {x€IR:  3  h  €  Ftg,k)  such  that  h(x)  =»  gtx)}. 


and,  for  each  x  6  IR, 


h^(x)  =inf{h(x):  hfc  F(g,k)}. 


Our  principal  result  is  the  following: 

THEOREM:  Let  G  be  a  distribution  with  density  g,  such  that  r|>  =  -  g*/9  is 
continuous ly-di f f erentiable  and  ^  has  finitely  many  intervals  of  increase. 
Then: 


(i)  For  each  k  >  0,  there  exists  an  integer  N  =  N(k)  and  -“>  <  a^  <  b^  < 


<  b2  <• .  .<  bN  <  +  00  such  that 


Ctk)  =  (a. 


/-1  1 

vV  V=2  u  ‘W  • 


(ii)  For  each  k  >  0,  h^  has  the  form 


h^U)  “  g(x) 


if  x  €  C(k) 


_  j  /g  Ci>i)  sinh  t|(ai+1_x)5  +  ^Ta~^)sinh  [|(x-b 


sinh[-(a.+1-b.)] 


d  s 


if  x  €[bi(ai+1J,  1  <  i  <  N-l 


_ Codes 

0,  .  I  Avail  andTor 

j  Special 


=  gCa1>ek^X  al*  if  x  <  {if  ?  -») 

=  g(b  )ektbN  if  x  >  b  (if  b  ?  +«•) 

N  "  N  N 

liii)  For  each  e  >  0,  there  exists  k  =  k(e)  such  that  (l-e)h^  is  the 
probability  density  of  the  least  informative  distribution  in 
P£CG)  for  the  location  problem. 


The  least  informative  density  is  reduced  to  (l-£)g  at  the  peaks  of  g, 

so  it  is  on  the  boundary  of  the  neighborhood  P  (G) .  The  mass  removed  from 

the  peaks  is  redistributed  to  fill  in  regions  where  the  density  g  is  steepest. 

The  pure  scale  parameter  problem  involves  estimating  CT  for  a  family  of 
X  x 

densities  —  gl— ),  a  >  0.  The  Fisher  information  for  scale  is 
O  a 

-  jr/f-  *  -  i]  2  9<*>a*- 


Since  the  scale  problem  can  be  transformed  into  the  location  problem  by 
taking  logarithms,  the  principal  theorem  also  determines  the  form  of  the 
least  informative  distribution  for  the  scale  problem.  [Alternatively,  following 
Thall  (1979) ,  the  results  can  be  derived  directly  in  the  scale  problem 
setting.]  As  in  Huber  0-981),  §5.6,  we  consider  symmetric  distributions 
F  €  P£CG),  and  obtain  the  following  result: 

COROLLARY :  Let  G  be  a  distribution  with  density  g,  such  that  X*  has  finitely 
many  intervals  of  increase,  where  X(x)  =  -  xtyfx)- 1.  Then  for  each  £  >  0,  the 
least  informative  density  in  P£IG)  for  the  scale  problem  has  the  form 


fix)  =  U-e)glx) 


if  t.  <  x  <  ]t. , 
a  -  _  i 


■  U-e>  <  - I7TT - iT - ( 

x  lti*rV  J 


i  =  1,2, ...,N 
2 


if  u.  <  x  <  t. 


.  -i  r 


i  =  1,2 


N-l 


The  Differential  Equation  and  Solution:  Since  a  key  differential  equation 
arises  in  Huber's  condition  for  the  least -informative  density,  we  begin  with  a 
brief  description  of  his  method  for  log-concave  g.  Consider  a  distribution 
F  €  P^ (G)  with  density  f,  and  suppose  that  i|)  =  -  f'/f  is  continuous  and 
piecewise  differentiable.  Then  F  is  the  least  informative  distribution  in 
P£CG)  if  and  only  if  for  some  k  >  0 

l*)  /IX2  +  2iji'-ifi2)  (f^-f)  >  0 

for  all  =  F| ,  where  F^  €  {f  £  P^  (G) :  1(F)  <  If  g  is  log-concave,  this 

condition  is  satisfied  by  setting  f  =  (l-e)g  when  |  <  k  to  obtain  both 

f^  >  f  and  k2  +  2ty'  -  ij)2  >  2'!'^  >  0,  and  letting  f  be  a  multiple  of  e**  or 

e  on  intervals  ’.shere  >  k  to  obtain  k2  +  2 1|»*  -  ty2  -  0. 

An  important  observation  is  that,  while  log-concavity  is  sufficient  to 
2  2 

obtain  k  +2\|>'  -  \}i  >  0,  it  is  not  necessary.  This  suggests  replacing  tl-£)g 

2  2 

by  a  density  which  satisfies  the  differential  equation  k  +  2ty'  -  «=  0  on 

2  2 

an  interval  where  Ity  1  <  k  and  k  +  2ty'  -  ijj  <0. 

■  g 1  g  g 

The  different  equation  system 

k2  +  2<f»'  -  V*  *  0 
♦  -  -  f'/f 

I'M  <  k 

may  be  solved  by  separation  of  variables,  to  obtain  solutions  of  the  form 
\p(z)  =  ^Cz;k,c)=-k  tanh  [j(z-c)  ] 

f(z)  =  f  (z;k,c,d)  =  d  cosh2  Ij(z-c)  J  *  ~  coshlk(z-c)]  + 

where  d  >  0  and  c  €  IR.  Note  that  for  any  fixed  k,  a  function  f(*;k,c,d)  is 
uniquely  determined  by  the  values  at  two  points. 


The  function  f(-;k,c,d)  passing  through  (a^.b^)  and  (a2*b2^  where  a^  <  a^, 
is  given  by 

r»^  sinh[j(a2-z)  ]  +  /b2  sinhl^tz-a^  ]  '  2 
sinh[^Ca2~a^)  ]  _  , 

the  form  employed  in  the  statement  of  the  Theorem. 

For  each  k  >  0  and  x  £  IR,  let  g(*;k,x)  denote  the  function  f(-,*k,c,d) 
such  that  f (x;k,c,d)  =  g(x)  and  f ' (x;k,c,d)  =  g‘(x).  We  find  that 


g(*  ;k,x)  =  f  (.*;k,c(k,x)  ,d(k,x)) 


where 


i  /kHyx) 
c(k'X)  klog\MTuT 


;  ♦  <x) 

d(k,x)  =  g(x)  ll - 2-r — 

i.  k  ^ 

Note  that  c  and  d  are  continuous  functions  of  k  and  x  in  the  region  where 

I^OOl  <  k. 

For  each  x  £  C(k),  g(-;k,x)  is  the  element  of  F(g#k)  that  lies  above  g 
everywhere  on  IR  and  is  tangent  to  g  at  x. 

For  any  s  <  t,  and  s,  t  £  C(k),  either  g(z;k,s)  <  g(z;K,t)  V  z  <  s  and 
g(z;k,t)  <  g(z,k,s)  V  z  >  t,  or  g(*;k,t)  =  g(*;k,s),  since  two  points  uniquely 
determine  a  function  of  this  form. 

The  Structure  of  C(k):  Letting  ij),  ..(•)  =  -  g*  (•  ;k,x)/g(*  ;k,x) ,  by 

”  — — —  "  Xr  X 

tangency  of  g  and  g(*;k,x)  at  x  we  have 

<i^x)  =  ~  k  tanh[j(x-c(k,x))] 


so  |^(x)  |  <  k. 
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■•'  J.'  “■  X-*  <"  <*  V.-  (■  V 


I 


I 


Note  also  that  for  x  £  C(k),  g"  (x)  <  g" (x?k,x)  since  g(z)  <  g(z,-k,x) 
for  all  z  €  R.  Therefore 


tpg(x)  =  -  g"(x)/g{x)  +  ipglx) 


>  -  g"  (x;k,x)/g  (x;k,x)  +  ij)  (x) 

Kf  X 


so 


=  lx(xl- 


k2  +  2**  cx)  -  'lu(x)  >  k2  +  2M  Cx) 

9  ^  "  KfX 


*k,x<*> 


=  0. 


Therefore 

C(k)  <=  B(k) 


=  {x  £  K:  | t// (jc)  j  <  k  and  k  +  2ip'  Cx)  -  ty2  (x)  >  0}. 


Since  ?/)'  has  finitely  many  intervals  of  increase  and  decrease,  for  each 

k  >  0,  B(k)  is  a  finite  union  of  intervals  B^ (k) ,  i  =  1, 2, . . . , N(k) . 

For  a  fixed  i,  suppose  that  there  exist  s,  t  £  C(k)  H  B^  Ck) ,  where 

s  <  t.  Consider  x  £  (s,t),  and  construct  g (* ;k,x) .  By  construction, 

11)'=  hit*  -  k2)  on  (s,t).  On  (s,t)  £  B  (k) ,  k2  +  2<p'  -  ij/2  >  0,  which  implies 
Xf  x  Xf  x  i  y  y 

2  2 

that  >  >j(<|)  -k  ).  Since  g  and  g{*;k,x)  arctangent  at  x,  i|)(x)  =  i|),  Cx) , 
g  -  g  g  k,x 

Therefore  i|)(z)  >  \p  (z)  for  x  <  z  <  t,  and  i|)(z)  <  i|).  Cz)  for  s  <  z  <  x. 

9  —  K  /  X  "  9  ”*  X|X  "  • 

Integrating,  we  obtain  for  x  <  y  <  t 


log  -  fy*lz>dz  >  r\  (z)dz  -  log 

gty)  xTg  -  xTcfx  3  g(y;k,x) 


SO 


gCy;k,x)  >  gCy)  V  x  <  y  <  t. 


Similarly, 


gty;k,x)  >  gCy)  V  s  <  y  <  x. 


s,v 

l-:;' 

c 

•On 

I 


-  -  - 


> . 


u 


.  AWaV.':  ’  .*  V  *.*> 
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For  y  <  s, 


s 


Therefore,  g(*;k,x)  >  g  on  IR,  so  x  6  C(k). 

Hence  C(k)  is  union  of  intervals  C^(k),  with  (k)  c  B^(k). 

[For  some  i,  (k)  may  be  empty.] 

Suppose  x  is  the  right  endpoint  of  C^(k),  where  C^(k)  {x}.  If 

Ityx)  |  <  k,  chen  by  continuity  of  c(k,x)  and  d(k,x),  we  have  for  each 
z  t  1R 


g(z;k,x)  =  lim  g(z;k,y)  >  g(z), 
ytx 


SO  x  f  C.  (k) . 


If  |i^(x)  |  =  k,  then  x  i  C(k),  since  if  g  and  g(*;k,x)  were  tangent, 

| ip  |  =  1'/'.  |  =  | -k  tanh[“ ( x-c  (k, x) )  ]  |  <  k. 

1  g  '  k,x'  '  2 


Furthermore, 


-9- 


0**  /•  /•  .  ‘  ■  ,”V  d 


v  yVv  .*•- 


h- 


g  (y;k,x) 

>  g(y;k,s) 

>  g(y) 

/V 

1 

and  for  y  >  t, 

t 

> 

» 

g(y;k,x) 

>  g(y;k,t) 

>  g(y)* 

to 

1 

F-.. 


8* 


(•’ 


lim  c(k,y)  =  +  »  and  lim  d(k,y)  =  0. 
ytx  y+x 


For  y^,  y2  €  Ci (k) ,  y2  <  y2  <  x,  recalling  that  g(z;k,y1>  >  g(z;k,y2>  Y  z  >  yj( 
and  expressing  g(-;k,y)  in  terms  of  hyperbolic  sine  functions,  we  obtain  * 

nr 

monotone  convergence  at  each  z  >  x: 


m 


•.  -i 


2 


lim 

ytx 


^j(y)sinh[^(.c  tk,y)-z)  ]  +  /d  (k,y) sinht^(z-y) ] 
sinhl~ (c(k,y) -y)  ] 


=  g(x)e 


k(x-z) 


Thus,  there  is  no  >  x  such  that  x^  €  C(k),  since  otherwise  there  exists 
f(*;k,c,d)  which  is  either  tangent  to  the  exponential  function  or  intersects 
it  twice,  in  either  case  violating  | f ’ {• ; k,c, d)/f (• ;k,c,d) |  <  k. 

Therefore,  C(k)  includes  the  right  endpoints  of  all  intervals  (k) 
except  possibly  the  rightmost.  Similarly,  C(k)  includes  the  left  endpoints  of 
all  subintervals  C^(k)  except  possibly  the  leftmost. 

The  Form  of  h^:  Note  that 

h  (x)  =  inf {f (x) :  f  €  F(g,k)  and  f (y)  =  g(y)  for  some  y  6  IR}. 

Jv 

If  x  €  C(k),  clearly  h^tx)  =  g(x).  If  x  j?  C(3c),  then  x  €  (s,t)  C  C(k)°, 
where  s  and  t  are  endpoints  of  intervals  of  C(k)  . 

We  claim  that  if  ts,t]  is  bounded,  then  on  [s,tj 

hk  =  g(*  ;k,s)  =  g(-;k,t). 

In  this  case  s,t  6  CCk)  by  the  previous  subsection.  Thus,  g(.t;k,s)  >  git) 
and  gts;k,t)  >  g(.s).  Suppose  the  first  of  these  inequalities  is  strict.  Then 
there  exists  £  >  0  such  that  V  z  £  IR 

g{z-E;k,s)  =  d (k, s) cosh2 [^(.z-e-c Ck, s) ) ]  >g(z). 


and  thus  for  some  b  <  1,  there  exists  y  €  (s,t)  such  that  bg(y-E;k,s)  =  g(y) 
and  bg(z-£;k,s)  >  g(z)  V  z  C  IR.  This  implies  that  y  6  C(k),  which  is  a 
contradiction,  so  in  fact  g(t;k,s)  =  g(t),  and  similarly  g(s;k, t)  =  g(s). 
Since  two  points  determine  a  function  of  this  form,  g(-;k,s)  =  g(*;k,t). 

Suppose  there  exists  w  6  (s,t)  such  that  h^lw)  <  g(w;k,s)  =  g(w;k,t). 
Then  for  sufficiently  small  £  >  0,  there  exist  c  and  d  such  that  f(*;k,c,d) 
>  g  on  DR  and 
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f  (w;k,c,d)  <  h^tw)  +  e  <  g(w;k,s). 

Since  fts;,k,c,d)  >  gCs)  and  f(.t;k,c,d)  >  g(t),  fC*;,k,c,d)  intersects 
g C* ; k, s)  at  two  points,  so  the  two  functions  are  identical.  -This 
contradiction  establishes  that  on  [s,t] 

h^  =  g(*;k,s)  =  g(-;k,t). 

If  [t,+°°)  c:  Ctk)  »  where  t  is  an  endpoint  of  (k)  for  some  i,  then 
i|{^t)  =  k.  To  see  this,  note  that  if  ij^.t)  <  k,  by  continuity  of  c(k,x)  and 
d(k,x)  as  above,  g(z;k,t)  >  g(z),  V  z  €  R,  and  gt*;k,t)  is  not  tangent  to  g 
at  any  point  z  >  t.  By  translating  g(*;k,t)  to  the  right  by  a  sufficiently 
small  £  >  0,  then  reducing  the  coefficient  until  the  resulting  curve  is 
tangent  to  g,  we  see  that  there  exists  x  >  t  with  x  6  C(k),  which  is  a 
contradiction. 

Since  tygCt)  =  k,  the  reasoning  in  the  previous  subsection  shows  that, 
for  z  >  t, 

h^Czl  =  lim  gCz;k,x>  =  gCt)ek^ 

'  x+t 

c 

Similarly,  if  C_00»sJ  c  C(k)  ,  where  s  is  an  endpoint  of  C^Ck)  for  some  i, 

then  for  z  <  s,  h^Cz)  =  g(s)ek^Z  . 

Pointwise  Convergence :  A  straightforward  computation  shows  that  for 

k*  >  k,  x  €  IR,  g(z;k*,x)  >  gtz;k,x)  for  all  z  €  IR.  Therefore 

if  x  €  C(k),  then  x  €  C(k*)  also. 

N  (k) 

Recall  that  C  ik)  =  U  C.  tk)  ,  where  each  C.  (k)  is  an  interval.  We 

i=l  1  1 

denote  the  endpoints  of  C^(k)  by  a^  (k)  and  b^  (k) ,  with  a_^(k)  <  b^  (k)  for  all 


i  and  b,  Ck)  <  a.  ,  (k)  for  i  =  1, . . .  ,N{k)-l.  There  are  finitely  many  values 


f  (w;k,c,d)  <  h^Cw)  +  E  <  g(w;k,s). 


Since  fls;,k,c,d)  >  gls)  and  f(±;k,c,d)  >  g(t),  f(*;»k,c,d)  intersects 
gl*;k,s)  at  two  points,  so  the  two  functions  are  identical.  -This 
contradiction  establishes  that  on  [s,t) 


hk  =  =  9 (*;k,t), 


If  [t,+“>)  c  C(k)  ,  where  t  is  an  endpoint  of  C^(k)  for  some  i,  then 
i|ylt)  =  k.  TO  see  this,  note  that  if  t|^t)  <  k,  by  continuity  of  c(k,x)  and 
dlk,x)  as  above,  gCz;k,t)  >  g(Z),  V  z  €  IR*  and  gC*»k,,t)  is  not  tangent  to  g 
at  any  point  z  >  t.  By  translating  gl-;k,t)  to  the  right  by  a  sufficiently 
small  e  >  0,  then  reducing  the  coefficient  until  the  resulting  curve  is 
tangent  to  g,  we  see  that  there  exists  x  >  t  with  x  6  C(kl,  which  is  a 
contradic  tion . 

Since  <JKt)  =  k,  the  reasoning  in  the  previous  subsection  shows  that, 
for  z  >  t. 


h.Czi  =  lim  gCz;k,xi  =  gCt)e 
x+t 


kCt-z) 


Similarly,  if  (-00, s]  c  c(k)  ,  where  s  is  an  endpoint  of  C^(k)  for  some  i, 

then  for  z  <  s,  h^Cz)  =  g(s)ek^z  . 

Pointwise  Convergence:  A  straightforward  computation  shows  that  for 

k*  >  k,  x  €  IR,  g(z;k*,x)  >  glz;k,x)  for  all  z  €  IR.  Therefore 

if  x  C  C(k),  then  x  €  CCk*)  also. 

Nik) 

Recall  that  Clk)  =  U  C.lk),  where  each  C.  (k)  is  an  interval.  We 

i=l  1 

denote  the  endpoints  of  (k)  by  a^  (k)  and  b^  (k) ,  with  (k)  <  b^  (k)  for  all 
i  and  b.  Ik)  <  a.  Ik)  for  i  =  1, . . .  ,N(k)-l.  There  are  finitely  many  values 


Cv 


of  k  at  which  NCk)  is  discontinuous.  Hence,  for  every  k*  >  0,  there 
exists  k**  >  k*  such  that  NCk)  is  constant  for  k*  <  k  <  k**  and  C^(k)  C 
C^(k**)  for  all  i  for  k*  <  k  <  k**. 

By  monotonicity  of  C(k)  in  k,  we  have 


lira  a  ik)  <  a  Ck*)  and  lim  b  (k)  >  b  (k*) . 
k+k*  1  k+k* 

On  the  other  hand,  if  x  €  C(k)  for  all  k  >  k*,  by  continuity  of  g(*jk,x)  in 

k,  then  x  £  CCk*).  Thus, 

lira  a  (k)  >  a.  (k*)  and  lim  b.  (k)  <  b.  (k*)» 
k+k*  1  1  k+k*  - 


so  equality  holds.  Since  h^  depends  continuously  upon  k  and  the  endpoints 
of  the  intervals  Ck) , 

lim  h.  Cz)  =  \ t  (z)  V  z  €  JR. 
k+k*  * 

We  now  consider  pointwise  convergence  of  h^  as  k  increases  to  k*.  As 
before,  there  exists  k**  <  k*  such  that  N(k)  is  constant  for  k**  <  k  <  k*. 
Suppose  1  <  i  <  NCk).  Then  for  b^Ckl  <  z  <  a^+^  Ck) , 

h^Cz)  =  gCz;k,b^  (k)  )  =  g(zyk,ai+1(k))  . 


By  monotonicity  of  C(k),  we  have  that 


lim  b. (k)  =  b.  and  lim  a  Ck)  *  a. 
ktk*  1  1  k+k* 


exist,  and  therefore  h  converges  pointwise  monotonies lly  to 

H Cz)  =  g(z;k*,b^)  =  g{z;k*,ai+J)  V  ^  <  z  <  a^ 


By  continuity  of  g(-;k,x)  in  k  and  x,  g(*;k,bj  >  g  on  R,  and  is  equal  to 
g  at  b.  and  a.  .  Therefore 


K-'- 


.  .v> 


>■  J."  ^  m  1_«  .  ■  J_«  J_» 


r*  TTTrrmrm 


riFJ  A1.’,  y  ■■  ■■  ijp»» 


h.  #  (z)  =  H(z)  =  lim  h(z) 
K  ktk* 


for  b.  <  z  <  a. . 
a  -  -  i+l 


Since  lim  h.  =  g  =  h.  ,  on  (a.,b.)  for  1  <  i  <  N(k),  we  have  pointwise 
ktk*  k  k  11 

convergence  of  h,  to  h.  .  on  (a,  ,b  ..  .  ) .  The  argument  is  complete  if  a,  *  - 
*  k  k*  1  N(k)  1 

and  bNUO  ■  +  ”• 

Suppose  bN^kj  <  +  °°.  Then  for  z  >  bN^kj  (k) , 

V*>  -  9(b  (k),ekU>(I(«0'>*a> 


k 

$ 

m 


& 

U 


By  monotonicity  of  C  (k) , 


lim  *Wi  00 
ktk*  N(Jc) 


b  exists 
N 


and  therefore 


lim  h  (z)  =  g(b  )ek  *bN  2* 
ktk*  *  N 

Jf  /  v—2)  « 

By  continuity  of  g(x)e  in  x  and  k,  and  the  fact  that  hk  >  g, 

g*(b  )ek*^"Z--  >  g(z)  on  {bN>  +  °°)  with  equality  at  bN-  Thus, 

h^*  (z)  =  g(bN)ek  {bN  z)  =  lim^tz) 

ktk* 

for  all  z  >  b  .  A  similar  argument  applies  if  a  >  -  00 ,  so  h  converges 

—  N  1  K 

pointwise  to  h,  *  on  JR. 

x 

Continuity  of  the  Integral :  Clearly  h^  is  integrable  for  each  k  >  0,  since 
there  are  finitely  many  intervals  in  Ctk)  and  h^  is  integrable  on  each  interval 
of  Ctk)  and  C(k)°. 

Using  monotonicity  of  h^  in  k  to  provide  a  dominating  function,  by  pointwise 
convergence  and  the  dominated  convergence  theorem,  we  obtain 


•>;VJ 


c. 


lim  /  h,  =  /  h.  . 
k->k*  R  k  IR  k* 


f 
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for  each  k*  >  0. 


Thus,  h^  is  a  continuous  function  of  k. 


We  now  show  that  lim  /  h.  =  +  Note  that  |tj».  |  <  k,  or  equivalently, 
k<0  R  K  K 


-  k  <  t-log  h.  ) '  <  k.  This  implies  that  for  any  x  C  IR  and  t  >  0, 


i  c>  ;  W8 


Choose  x  such  that  g(x )  =  max  g(x),  so  x  €  C(k)  Vk.  Then 

x€lR  v‘ 

<»  -kt  2hk(X0)  29(X0) 

V\W4‘  - !  ;o  W!  at — k - k - > * 

as  k  -*■  0. 

For  every  x  €  IR,  g(.z;k,x)  >  g(z)  Vz  €  1R  for  k  sufficiently  large,  so 

lim  h  tx)  =  g(x) .  Applying  the  dominated  convergence  theorem, 
k-**>  * 

lim  L  h.  «  /  g  =  1. 
k-H»  R  k  R 

Therefore,  for  each  e  >  0,  there  exists  a  kCc)  such  that 


/__  h  (t)  dt  =  -r— 
IR  kte)  1-e- 


Then  Cl~e)hk^ej  is  the  probability  density  function  of  a  distribution  in 

PelG). 

Least -Informative :  We  now  show  that  f  =  (l-ejh^^j  is  the  density  of 

the  least  informative  distribution  in  P£(G),  by  checking  condition  (*) . 

is  clearly  piecewise  differentiable,  and  at  each  endpoint  x  of  C(k(£)) 

tangency  of  g(-;k(e),x)  and  g  implies  that  (x)  =  ft,  ,  „(x) ,  so  l p  is 

g  x  i.ej  ,x 

continuous  at  x. 

On  CCk(e)),  k(e)2  +  2\p'  -  ty2  =  kCe)2  +  2 if/'  -  ty2  >  0  and  f  >  f  ®  (l-e)g, 
2  2 

while  on  Ctk(e))C,  k(e)  +  2ty'  -  if/  =  0,  so 

/  (k(e>2  +  2ip'  -  if,2)  (fj-f)  >  0 


for  any  f  =  F'  where  F^  6  P£ (G) . 
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